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SYSTEMS AND METHODS FOR ASSIGNING PRIORITY TO 
JOBS IN A REPORTING SYSTEM 

Field of the Invention 

This invention relates to a method and system for establishing priorities among 
competing jobs and for servicing those jobs using one or more processing units, wherein 
5 the jobs comprise reports, or query requests, to be processed in a reporting system, which 
may include an Online Analytical Processing (OLAP) system, business intelligence or 
other reporting system. 
Background of the Invention 

Existing reporting systems, and in particular data warehouse systems, operate by 

10 obtaining requests, either from users of the reporting system or from a scheduled event, for 
example, performing processing to address those requests, and thereafter outputting 
information to the user, for example, that is responsive to the request. Accordingly, it 
should be appreciated that a request may be a scheduled report or an alert, for example, 
and not just a user request. A request might be characterized as a "job." The ability to 

15 complete jobs as a result of a scheduled event or for a user, as well as any other individual 
utilizing the reporting system, depends both on the number of other requests, i.e., by other 
users, that has been submitted as well as the processing resources available to the 
reporting system. 
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One goal in existing reporting systems is to ensure efficient usage of processing 
resources in completing the various computing jobs. However, various other factors 
should also be taken into account. For example, processing very large jobs on a continued 
basis would ensure efficient usage of resources. However, such processing of very large 
jobs only would be to the detriment of a user who submits small jobs, which are not 
completed in a reasonable time. Accordingly, it is desired to prioritize jobs in some 
reasonable manner while insuring the efficient usage of processing resources. In addition, 
organizations may want to control how processing resources for a reporting system are 
divided among various user communities. However, conventional systems and methods 
fall short of addressing these desired objectives. Further, conventional methods and 
systems suffer from other drawbacks. 
Summary of the Invention 

The methods and systems of the invention provide for processing of jobs by 
initially assigning a priority to a job wherein the job is preferably a report being executed 
in a decision support system against a data warehouse. The priority may include a queue 
set priority, as well as a queue priority in accordance with embodiments of the methods 
and systems of the invention. Once the priority is assigned, the job is placed into a 
selected queue set, selected from a plurality of possible queue sets, based on the queue set 
priority assigned to the job. The job may also be designated to a particular queue within 
the selected queue set, i.e., based on the queue priority. Then, the job is processed based 
on the selected queue set, and possibly queue, into which the job is placed. 
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One aspect of the systems and methods of the invention relates to defining one or 
more queue sets. Each queue set may be defined based on one or more queue set factors. 
The queue set factors may include one or more of a range of priority values, or other queue 
set factors. Another aspect of the invention includes assigning one or more priority types 
5 to jobs. The priority types may include one or more of a queue set priority, a queue 
priority, a relative priority value (e.g., to prioritize jobs within a queue relative to one 
another) and other priority types. Once a job has been assigned its one or more priorities, 
one or more techniques may be used to determine one or more of: in which queue set the 
job should be placed (if more than one queue set is used), in which queue of a queue set 
10 the job should be placed (if a queue set has more than one queue) where within a queue 
the job should be placed relative to other jobs in the queue, and other priority 
determinations. 

A further aspect of the invention relates to the servicing of jobs. Servicing of the 
jobs, which have been prioritized, relates to selecting the next job to be serviced. This 
15 selection is based on the priority assigned to the job, a set of priority queues and an 
available thread, for example. In other words, the next available thread, i.e., the next 
available processing unit, performs the next job based on the priorities of each respective 
job. 

Other objects and advantages of the invention will be apparent to one of ordinary 
20 skill in the art upon reviewing the detailed description of the invention. 
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Brief Description of the Drawings 

Fig. 1 is a block diagram illustrating an architecture for a system according to an 
embodiment of the invention. 

Fig. 2 is a flowchart illustrating steps performed by a process utilizing a query 
5 engine according to an embodiment of the invention. 

Fig. 3 is a block diagram showing the analytical engine in further detail according 
to an embodiment of the invention. 

Fig. 4 is a flowchart showing a process of assigning priorities to and servicing jobs 
according to an embodiment of the invention. 
10 Fig. 5 is a block diagram showing the queue portion 400 in further detail according 

to an embodiment of the invention. 

Fig. 6 is a block diagram showing the queue portion 400 in further detail according 
to a further embodiment of the invention. 

Fig. 7 is a diagram showing a queue and illustrating the first in first out technique 
15 according to an embodiment of the invention. 

Fig. 8 is a diagram showing multiple queues and illustrating the fixed thread- 
selfish technique according to an embodiment of the invention. 

Fig. 9 is a diagram showing multiple queues and illustrating a fixed thread- 
cooperative technique according to an embodiment of the invention. 
20 Fig. 10 is a diagram showing multiple queues and illustrating a highest priority 

first technique according to an embodiment of the invention. 
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Fig. 1 1 is a diagram showing multiple queues and a thread pool illustrating a 
weighted share technique according to an embodiment of the invention. 

Fig. 12 is a flowchart showing a process to define a prioritization and servicing 
scheme according to an embodiment of the invention. 
5 Detailed Description of the Invention 

The present invention relates to systems and methods for prioritizing jobs, such as 
reports to be processed by a reporting system. As used herein, a "reporting system" may 
include an Online Analytical Processing (OLAP) system, a business intelligence system or 
other reporting system, for example. For context in understanding the present invention, 
10 Figs. 1 and 2 are shown that illustrate an embodiment of such a system for which the 
invention may be used. 

Fig. 1 is a block diagram illustrating a system 100 by which a variety of data 
resources may be accessed for business analytic, report generation and other intelligence 
purposes according to an embodiment of the invention. According to a preferred 
15 embodiment, the system 100 may comprise an Online Analytical Processing (OLAP) 
decision support system (DSS). In particular, Fig. 1 may comprise a portion of the 
MicroStrategy 7 or 7.1 platform which provides a preferred system in which the present 
invention may be implemented. 

In general, through using the system 100 of the invention, analysts, managers and 
20 other users may query or interrogate a plurality of databases or database arrays to extract 
demographic, sales, and/or financial data and information and other patterns from records 
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stored in such databases or database arrays to identify strategic trends. Those strategic 
trends may not be discernable without processing the queries and treating the results of the 
data extraction according to the techniques performed by the systems and methods of the 
invention. This is in part because the size and complexity of some data portfolios stored 

5 in such databases or database arrays may mask those trends. 

In addition, system 100 may enable the creation of reports or services that are 
processed according to a schedule. Users may then subscribe to the service, provide 
personalization criteria and have the information automatically delivered to the user, as 
described in U.S. Patent No. 6,154,766 to Yost et al 9 which is commonly assigned and 

10 hereby incorporated by reference. 

As illustrated in Fig. 1, a business, a government or another user may access the 
resources of the system 100 using a user engine 102. The user engine 102 may include a 
query input module 1 16 to accept a plurality of searches, queries or other requests, via a 
query box on a graphical user interface (GUI) or another similar interface. The user 

15 engine 102 may communicate with an analytical engine 104. The analytical engine 104 
may include a set of extensible modules to run a plurality of statistical analyses, to apply 
filtering criteria, to perform a neural net technique or another technique to condition and 
treat data extracted from data resources hosted in the system 100, according to a query 
received from the user engine 102. 

20 The analytical engine 104 may communicate with a query engine 106, which in 

turn interfaces to one or more data storage devices 108a, 108b ... 108n (where n is an 
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arbitrary number). The data storage devices 108a, 108b ... 108n may include or interface 
to a relational database or another structured database stored on a hard disk, an optical 
disk, a solid state device or another similar storage media. When implemented as 
databases, the data storage devices 108a, 108b . . . 108n may include or interface to, for 

5 example, an Oracle™ relational database such as sold commercially by Oracle 

Corporation, an Informix™ database, a Database 2 (DB2) database, a Sybase™ database, 
or another data storage device or query format, platform or resource such as an OLAP 
format, a Standard Query Language (SQL) format, a storage area network (SAN), or a 
Microsoft Access™ database. It should be understood that while data storage devices 

10 108a, 108b ... 108n are illustrated as a plurality of data storage devices, in some 
embodiments the data storage devices may be contained within a single database or 
another single resource. 

Any of the user engine 102, the analytical engine 104 and the query engine 106 or 
other resources of the system 100 may include or interface to or be supported by 

15 computing resources, such as one or more associated servers. When a server is employed 
for support, the server may include, for instance, a workstation running a Microsoft 
Windows™ NT™ operating system, a Windows™ 2000 operating system, a Unix 
operating system, a Linux operating system, a Xenix operating system, an IBM AIX™ 
operating system, a Hewlett-Packard UX™ operating system, a Novell Netware™ 

20 operating system, a Sun Microsystems Solaris™ operating system, an OS/2™ operating 
system, a BeOS™ operating system, a Macintosh operating system, an Apache platform, 
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an OpenStep™ operating system, or another similar operating system or platform. 
According to one embodiment of the present invention, analytical engine 104 and query 
engine 106 may comprise elements of an intelligence server 103. 

The data storage devices 108a, 108b . . . 108n may be supported by a server or 

5 another resource and may, in some embodiments, include redundancy, such as a redundant 
array of independent disks (RAID), for data protection. The storage capacity of any one or 
more of the data storage devices 108a, 108b . . . 108n may be of various sizes, from 
relatively small data sets to very large database (VLDB)-scale data sets, such as 
warehouses holding terabytes of data or more. The fields and types of data stored within 

10 the data storage devices 108a, 108b . . . 108n may also be diverse, and may include, for 
instance, financial, personal, news, marketing, technical, addressing, governmental, 
military, medical or other categories of data or information. 

The query engine 106 may mediate one or more queries or information requests 
from those received from the user at the user engine 102 to parse, filter, format and 

15 otherwise process such queries to be submitted against the data contained in the data 
storage devices 108a, 108b ... 108n. Thus, a user at the user engine 102 may submit a 
query requesting information in SQL format, or have the query translated to SQL format. 
The submitted query is then transmitted via the analytical engine 104 to the query engine 
106. The query engine 106 may determine, for instance, whether the transmitted query 

20 may be processed by one or more resources of the data storage devices 108a, 108b . . . 

108n in its original format. If so, the query engine 106 may directly transmit the query to 
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one or more of the resources of the data storage devices 108a, 108b . . . 108n for 
processing. 

If the transmitted query cannot be processed in its original format, the query engine 
106 may perform a translation of the query from an original syntax to a syntax compatible 

5 with one or more of the data storage devices 108a, 108b . . . 108n by invoking a syntax 
module 1 18 to conform the syntax of the query to standard SQL, DB2, Informix™, 
Sybase™ formats or to other data structures, syntax or logic. The query engine 106 may 
likewise parse the transmitted query to determine whether it includes any invalid 
formatting or to trap other errors included in the transmitted query, such as a request for 

10 sales data for a future year or other similar types of errors. Upon detecting an invalid or an 
unsupported query, the query engine 106 may pass an error message back to the user 
engine 102 to await further user input. 

When a valid query such as a search request is received and conformed to a proper 
format, the query engine 106 may pass the query to one or more of the data storage 

15 devices 108a, 108n . . . 108n for processing. In some embodiments, the query may be 
processed for one or more hits against one or more databases in the data storage devices 
108a, 108b . . . 108n. For example, a manager of a restaurant chain, a retail vendor or 
another similar user may submit a query to view gross sales made by the restaurant chain 
or retail vendor in the State of New York for the year 1999. The data storage devices 

20 108a, 108b . . . 108n may be searched for one or more fields corresponding to the query to 
generate a set of results 1 14. 
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Although illustrated in connection with each data storage device 108 in Fig. 1, the 
results 114 may be generated from querying any one or more of the databases of the data 
storage devices 108a, 108b ... 108n, depending on which of the data resources produce 
hits from processing the search query. In some embodiments of the system 100 of the 

5 invention, the results 1 14 may be maintained on one or more of the data storage devices 
108a, 108b ... 108n to permit one or more refinements, iterated queries, joinders or other 
operations to be performed on the data included in the results 1 14 before passing the 
information included in the results 1 14 back to the analytical engine 104 and other 
elements of the system 100. 

10 When any such refinements or other operations are concluded, the results 1 14 may 

be transmitted to the analytical engine 104 via the query engine 106. The analytical 
engine 104 may then perform statistical, logical or other operations on the results 1 14 for 
presentation to the user. For instance, the user may submit a query asking which of its 
retail stores in the State of New York reached $1M in sales at the earliest time in the year 

15 1999. Or, the user may submit a query asking for an average, a mean and a standard 
deviation of an account balance on a portfolio of credit or other accounts. 

The analytical engine 104 may process such queries to generate a quantitative 
report 1 10, which may include a table or other output indicating the results 1 14 extracted 
from the data storage devices 108a, 108b . . . 108n. The report 110 may be presented to the 

20 user via the user engine 102, and, in some embodiments, may be temporarily or 

permanently stored on the user engine 102, a client machine or elsewhere, or printed or 

10 
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otherwise output. In some embodiments of the system 100 of the invention, the report 1 10 
or other output may be transmitted to a transmission facility 112, for transmission to a set 
of personnel via an email, an instant message, a text-to-voice message, a video or via 
another channel or medium. The transmission facility 112 may include or interface to, for 

5 example, a personalized broadcast platform or service such as the Narrowcaster™ 
platform or Telecaster™ service sold by MicroStrategy Incorporated or another similar 
communications channel or medium. Similarly, in some embodiments of the invention, 
more than one user engine 102 or other client resource may permit multiple users to view 
the report 1 10, such as, for instance, via a corporate intranet or over the Internet using a 

10 Web browser. Various authorization and access protocols may be employed for security 
purposes to vary the access permitted users to such report 110 in such embodiments. 

Additionally, as described in the '766 Patent, an administrative level user may 
create a report as part of a service. Subscribers/users may then receive access to reports 
through various types of data delivery devices including telephones, pagers, PDAs, WAP 

15 protocol devices, email, facsimile, and many others. In addition, subscribers may specify 
trigger conditions so that the subscriber receives a report only when that condition has 
been satisfied, as described in detail in the 766 Patent. The platform of Fig. 1 may have 
many other uses, as described in detail with respect to the MicroStrategy 7 and 7.1 
platform, the details of which will be appreciated by one of ordinary skill in the reporting 

20 and decision support system art. 
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The steps performed in a method 200 for processing data according to the 
invention are illustrated in the flowchart of Fig. 2. In step 202, the method 200 begins. In 
step 204, the user may supply input, such as a query or a request for information, via the 
user engine 102. In step 206, the user input query may be preliminarily processed, for 
5 instance, to determine whether it includes valid fields and for other formatting and error- 
flagging issues. In step 208, any error conditions may be trapped and an error message 
presented to the user, for correction of the error conditions. In step 210, if a query is in a 
valid format, the query may then be transmitted to the analytical engine 104. 

In step 212, the analytical engine 104 may further process the input query as 

10 appropriate to ensure the intended results 114 may be generated to apply the desired 
analytics. In step 214, the query engine 106 may further filter, format and otherwise 
process the input query to ensure that the query is in a syntax compatible with the syntax 
of the data storage devices 108a, 108b ... 108n. In step 216, one or more appropriate 
databases or other resources within the data storage devices 108 a, 108b . . . 108n may be 

15 identified to be accessed for the given query. 

In step 218, the query may be transmitted to the data storage devices 108a, 108b . . . 
108n and the query may be processed for hits or other results 114 against the content of 
the data storage devices 108a, 108b ... 108n. In step 220, the results 114 of the query may 
be refined, and intermediate or other corresponding results 1 14 may be stored in the data 

20 storage devices 108a, 108b . . . 108n. In step 222, the final results 1 14 of the processing of 
the query against the data storage devices 108a, 108b ... 108n may be transmitted to the 
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analytical engine 104 via the query engine 106. In step 224, a plurality of analytical 
measures, filters, thresholds, statistical or other treatments may be run on the results 1 14. 
In step 226, a report 110 may be generated. The report 1 10, or other output of the analytic 
or other processing steps, may be presented to the user via the user engine 102. In step 

5 228, the method 200 ends. 

Hereinafter, further aspects of the systems and methods of the invention will be 
described with reference to the analytical engine 104 and the report 1 10. That is, as 
described below, the invention will be described with reference to establishing priorities 
among report jobs processed in the analytical engine 104, and for servicing those jobs 

10 within a processing unit. However, it should be appreciated that the priority schemes and 
techniques described herein could be used in any environment in which jobs are 
prioritized prior to processing. 

Fig. 3 is a block diagram illustrating an architecture for the analytical engine 104 
according to an embodiment of the invention. As shown in Fig. 3, the analytical engine 

15 104 includes a priority setting portion 300, a queue placement portion 310, and a service 
portion 320. The priority setting portion 300 interfaces with the user engine 102, for 
example, in order to assign priorities to the various individual jobs. The queue placement 
portion 310 places jobs in a particular queue based on the priority assigned to that job. 
Further, the service portion 320 performs the dequeuing and service of jobs based on the 

20 assigned priorities. It should be appreciated, and as will be discussed below, the analytical 
engine 104, in accordance with one embodiment, functions so as not to restrict a system 
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administrator's ability to control the flow of job execution. The analytical engine 104 also 
provides several methods for determining both job priorities and controlling job servicing. 

The analytical engine 104 also includes a memory 340. As described below, the 
memory 340 stores various data related to operations of the priority setting portion 300 

5 and the service portion 320. The memory 340 also includes a queue portion 400. The 
queue portion 400 stores data representing pending jobs and the disposition of those jobs 
within queues. The priority setting portion 300, the queue placement portion 310, the 
service portion 320 and the memory 340 may be connected by a suitable interface 360. 
Hereinafter, various aspects relating to operations of the priority setting portion 

10 300, the queue placement portion 310, and the service portion 320 will be described. As 
used herein, a "job" may include, but is not limited to, any of a wide variety of requests 
from users requiring processing by a reporting system , including but not limited to, a 
report request (e.g. a single OLAP question); a document request, where a document is 
essentially a set of multiple reports; or an element browse request, where "browsing 

15 elements" is essentially scanning through records in a database table, for example. As 
used herein, a "thread" may be characterized as an entity that provides services to jobs. 
Illustratively, a thread may represent a processing system that processes jobs in sequence. 
Further, "prioritization" may be characterized herein as assigning a relative job priority to 
a job. Further, "servicing" may be characterized as selecting the next job to be serviced 

20 based on a set of priority queues and an available thread. In other words, the next 

available thread, i.e., a processing unit, performs the next job based on the priorities. It 
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should be appreciated that the prioritization and servicing of jobs using threads, or other 
suitable processing units, could be utilized in any of a variety of environments in which 
jobs are prioritized prior to processing. 

As described in further detail below, it should be appreciated that the priority 

5 provided to a given job may vary depending on a variety of factors as is desired. In 

accordance with the systems and methods of the invention, the priority of a particular job 
may be based on user identification, i.e., which user requested the particular job, for 
example. That is, the priority setting portion 300 is provided with the ability to prioritize 
jobs based on user identification. Further, jobs may be prioritized based on estimated 

10 time, and/or cost. Priority may also be based on project, including where a project is an 
application domain, such as finance or marketing, i.e., marketing jobs could be prioritized 
ahead of finance jobs. Further, priority may be based on Report Type, where Report Type 
indicates if the report is an initial question or a follow-up question to a previous question. 
For example, follow-up questions could be prioritized ahead of initial questions. 

15 In further explanation of the systems and methods of the invention, prioritizing 

based on user identification may include individuals (user names) or roles (all Vice 
Presidents, regional sales managers, etc. for example) or other identifications. 

It should be appreciated that the priority of a job may be based on a wide variety of 
factors. For example, priority may be based on whether the report is requested by an 

20 individual or is a scheduled report intended to go to a group of users or an alert. Further, 
if a report, for example, is going to a group of persons, the number of people in the group 
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and/or the roles of the people in the group may be taken into account in the priority. 
Further, a priority scheme may be established in which scheduled jobs take priority over 
requested jobs at night, but scheduled jobs do not take priority over requested jobs during 
the day. 

In accordance with one embodiment of the systems and methods of the invention, 
system administrators may be able to override priority and servicing schemes by manually 
changing the priority of a job in a queue. That is, the priority setting portion 300 provides 
the ability to alter a job priority once it is entered into a queue. Accordingly, this feature 
provides an administrator flexibility when job completion priorities vary from the routine. 

In accordance with one embodiment of the systems and methods of the invention, 
the priority of a particular job may be set automatically based on predefined formulas. 
These formulas can be based on any data, i.e., any variable, available to the system 100. 
Alternatively, the formulas for prioritization may be based on a user-defined function, for 
example. 

In accordance with a further aspect of one embodiment of the invention, it should 

be appreciated that a priority of a job may be based on the particular user requesting the 

job, as described above. Relatedly, a "fair share" technique may be utilized in some 

embodiments of the invention. In the fair share technique, each additional job in a queue 

from a particular user is assigned a progressively lower priority. That is, the first job is 

priority one, the second priority two, and so forth. By utilizing a type of fair share 

technique, each user has a "fair" access to the processing capabilities of the system 100. 

16 
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Once a job is done executing, all of the users' other jobs may then be "bumped" up in 
priority by the priority setting portion 300 based on output from the service portion 320 
that a job was completed. 

It should be appreciated that one goal of the analytical engine 104 is to prioritize 
and service jobs in such a manner as to ensure efficient usage of resources. There may, of 
course, be a variety of resources available to the analytical engine 104. For example, a 
relational database manager server (RDBMS) that services warehouse queries may be 
utilized as a processing resource. Additionally, a RDBMS that services metadata queries 
may be utilized. Further, any number of analytical processing engines may be utilized. To 
explain further, the analytical engine 104, including the priority setting portion 300 and the 
service portion 320, provides the ability to strike a balance between two or more goals, as 
is desired, through establishing a priority technique and a job servicing technique. 

In accordance with one embodiment of the systems and methods of the invention, 

one goal is to optimize total system throughput. Another goal is to optimize individual 

query response. It should be appreciated that high throughput ensures that the processing 

system being utilized to complete the various jobs experiences stable, full utilization; and 

that as many report requests as possible are fulfilled in as short a time as possible. At the 

same time, however, it should be appreciated that users, i.e., customers for example, want 

to ensure that some sense of "fair share" is granted to all the various jobs that require the 

system resources. Accordingly, it should be appreciated that the systems and methods of 

the invention allow a balance to be attained between these and other goals, as desired. 

17 
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Accordingly, goals which may be taken into account include system throughput, more 
quickly processing more urgent or important reports, and if desired "fair share," for 
example. 

For purposes of illustration, the following examples are included in accordance 
5 with embodiments of the methods and systems of the invention. The examples show 
different schemes that may be put into place to prioritize jobs. 

Example 1 - Company A 
There are two projects: Production project, Training project. There are also two 
user groups: Production users, Training users. The priority function: any job from the 
10 Production project is higher priority than Training project. The total number of queues: 
Two, one for Production project, one for Training project. The job servicing issues 
includes needs to avoid job starvation; and the Training project needs to get some access 
to the database. 

Example 2 - Company B 

15 There are two projects: Sales project, Operations project. Also, there are three user 

groups: Sales managers, Operations managers, VP of Operations. The priority function 
includes jobs in the Sales project from sales managers receive high priority, as do jobs in 
the Operations project from operations managers; jobs in the Sales project from operations 
managers and jobs in the Operations project from sales managers receive low priority; and 

20 jobs from the VP of Operations in either project receive highest priority. Further, the total 
number of queues: Three, one for Sales project-Sales managers and Operations project- 
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Operations managers, one for Sales project-Operations managers and Operations project- 
Sales managers, and one for VP of Operations. 

As should be appreciated by the above examples, a variety of priority schemes may 
be used in accordance with embodiments of the methods and systems of the invention. 

5 For example, a default scheme may be used in which all jobs are processed on a first in, 
first out basis. Further, a simple "priority by report cost" scheme may be used in which 
jobs are prioritized solely by estimated report cost. Further, a simple "priority by user" 
scheme may be used in which jobs are prioritized solely based on the user who submitted 
the job. Also, a simple "priority by project" scheme may be employed in which jobs are 

10 prioritized solely based on the project where the job comes from. 

As described above, a job is submitted to the analytical engine 104 through a user 
using the user engine 102, for example. Once this job is submitted to the analytical engine 
104, the priority setting portion 300 establishes a priority of the submitted job. 
Prioritization may be characterized as the assignment of a relative priority to each job that 

15 is submitted to the engine 104. In accordance with one embodiment, this assignment of 
priority may be based upon a priority function that determines a priority value, given a set 
of relevant priority variables. Accordingly, when the system administrator defines a 
priority scheme, he or she is simply selecting the relevant priority variables and specifying 
a priority function in accordance with one embodiment of the systems and methods of the 

20 invention. Illustratively, priority for an individual job may be assigned based on three 
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priority variables. These three priority variables include project type, user, and cost. 
Other variables may also be used as desired. 

A job may be prioritized based on the nature of the project. Utilizing this variable, 
jobs from different projects will have different priority values and all jobs within a project 
5 will contain the same priority value, i.e., assuming that no other variables are factored into 
the prioritization. Accordingly, for example, all jobs in project A may have a higher 
priority than all jobs from project B. 

Priority may also be based on the user, i.e., the human person who submitted the 
job or the calling application acting as a user. All jobs submitted by the same user may 
10 thus have the same priority value, assuming no additional variables are factored into the 
prioritization. Accordingly, for example, all jobs from user A have a higher priority than 
jobs from user B. However, it should of course be appreciated that priority of a job may 
likely not be based on a particular project or user, but rather may be based on multiple 
factors. 

15 Illustratively, users may have a different relative priority based on the particular 

project that a particular user is submitting. Thus, if an accountant submits a job related to 
accounting or the accounting data, that job may have a higher priority than the same 
human accountant submitting a job related to marketing or the marketing data. It should 
thus be appreciated that in some circumstances it may be difficult to assign a single 

20 priority value to a particular user. Rather, priority may be assigned to a job based on a 
combination of user, project, as well as other factors as is desired. 
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Further, in accordance with one embodiment of the systems and methods of the 
invention, priority may be based on user groups, rather than individual users. This 
technique serves as a time-saver to system administrators. If a system administrator 
deems that an individual user does indeed need a separate priority since a set of users 

5 should all have the same priority, then the systems and methods of the invention allows 
the administrator to create a user group and include that user as well as others. 

Illustratively, a further priority value which may be used to assign priorities to 
individual jobs, is a cost parameter. For example, the engine 104 may be preparing a 
report. Accordingly, the cost parameter is a report cost. Submitted jobs may be 

10 prioritized based on an estimated cost value for the report. Cost is a general variable that 
can represent several different characteristics of the job. For example, report cost can 
include such parameters as a report priority, report type, historical report cost, and 
estimated or predicted report cost. Each of these characteristics is dictated by the nature of 
the report. In this illustrative example relating to report costs, it should be appreciated that 

15 a variety of other parameters or characteristics may be utilized as is desired. 

In further explanation of the report costs example, the "report priority" is a fixed 
priority for a given report. Thus, a system designer may assign a priority value to specific 
reports. This allows the system designer to specify certain reports that always receive 
special priority. Alternatively, reports that always receive low priority may be accorded a 

20 suitable report priority ranking. 
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Related to report priority, a further characteristic may be "report type." This 
property of a job indicates if the job was generated as a new report, as a data surf, or as a 
drill-down, for example. This characteristic allows the system designer to give higher 
priority to more "interactive" jobs, such as drill-downs and data surfs, for example. For 
example, a report created via a drill-down may have a higher priority than a standard 
report, or stated differently, a secondary or derived report may have a higher priority than a 
new report. In accordance with this illustrative embodiment, that the drill-down report 
might be created for follow-up analysis and should be returned to the user as quickly as 
possible. 

A further characteristic in accordance with this illustrative example is "historical 
report costs." This characteristic reflects an estimate of the complexity of the report based 
upon an historical record of executing the report in the past. The historical report costs 
may be established when the job is submitted based upon an historical record of running 
the same report. 

A further characteristic is "estimated report costs." This characteristic is an 
estimate of the complexity of the report based upon the analytical engine's 104 knowledge 
of the query that it generates as well as any other means of generating a predicted cost. In 
accordance with this technique, the priority setting portion 300 will first determine the 
estimated cost for a report and then assign it a priority. 

In accordance with one embodiment of the system method of the invention, 

"priority variables" may be utilized in a "priority function". The particular variables 
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utilized, as well as the priority function, will of course depend on the particular 
implementation of the method of the invention. A priority function defines a priority 
value based on the set of priority variables factored into the priority function. The priority 
variables and functions, which are utilized to determine the priority value of a given job, 

5 may vary as is desired. Once a priority value is determined, then that priority value allows 
the priority setting portion 300 to place a particular job in a queue set or queue. 

It should be appreciated that three priority variables are described herein including 
project, user and cost. Further, the cost variable, for example, is used to represent multiple 
report characteristics including the estimated cost, and historical cost, for example. 

10 However, rather than using cost to generalize multiple report characteristics, each 

characteristic could be represented as another priority variable in accordance with one 
embodiment of the systems and methods of the invention. That is, priority functions could 
be implemented as mappings of project, user, report, job type, historical cost, and 
estimated cost to result in a priority value, for example. This approach would eliminate 

15 the need to define a report cost function as something separate from a priority function. 
However, it may allow the number of input combinations to the priority function to grow 
very quickly. Accordingly, and as noted above, it should be appreciated that both the 
priority variables as well as the priority formulas or functions, utilized to produce a 
priority value based on the priority variables, may vary. It should be appreciated that 

20 priority functions may be site-specific, meaning that each customer, for example, will 
define the priority formula to meet their needs. Examples include the following, where 
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(Project, User, Report, Type, Historical Cost, Estimated Cost) represents one or more 
combinations of the seven priority variables: 

(any, User CEO, any, Drill-down report, any, any) -> Priority 1; 

(any, User CEO, any, Normal report, any, any) -> Priority 2; 
5 (any, any other User, any, Drill-down report, any, any) -> Priority 3; 

(any, any other User, any, Normal report, any, any) -> Priority 4; 

(Accounting Project, Accounting Manager, any, any, any, any) -> Priority 1; 

(Marketing Project, Marketing Manager, any, any, any, any) -> Priority 1; 

(Marketing Project, Accounting Manager, any, any, any, any) -> Priority 2; 
10 (Accounting Project, Marketing Manager, any, any, any, any) -> Priority 2; 

(Marketing Project, any other user, any, any, any, any) -> Priority 3; or 

(Accounting Project, any other user, any, any, any, any) -> Priority 3. 

Fig. 4 is a flowchart showing operation of the priority setting portion 300. As 
shown in Fig. 4, the process starts in step 302. Then, the process passes to step 303. In 
15 step 303, the job request is received and the priority setting portion 300, for example, 
inputs the priority variables of the job. Then, in step 304, a number is assigned to the 
priority variables, i.e., the priority variables are normalized as is described in further detail 
below. Then, the process passes to step 305. 

In step 305, the normalized priority variables are input into a priority formula. 
20 Then, in step 306, a priority value is output for each submitted job. As described below, 

the priority value may include a queue priority value and/or a queue set priority value. 
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After step 306, the process passes to step 307. In step 307, the job is placed into a queue 
based on the job's priority value. Then, the process passes to step 308. In step 308, the 
process ends. 

In accordance with one embodiment of the systems and methods of the invention 
and as noted above, the priority variables, which are utilized in the priority formula, may 
be normalized. This normalization may provide a weighting affect and/or may allow a 
"type" variable, for example, to be translated into a numerical value. 

Elustratively, with further reference to the report cost value example described 
above, the report priority is a property of a report definition, such as an integer value 
between 0 and 100. This value can be directly assigned to a job as a report cost by the 
requesting user. Further, the "report type" is a property of the job. A priority variable may 
be assigned to a job based on mapping of particular report types to report cost values, for 
example. Thus, perhaps a drill-down report maps to a report cost value of 40. Further, an 
historical cost can be assigned to a job based on a historical cost table. The historical cost 
may also be normalized to a standard scale. Further, the estimated cost as described above 
may be normalized in a suitable manner, such as in the same manner as the historical cost. 
It should be appreciated, this framework allows for report cost functions to be defined as 
arithmetic functions. 

As described above, various priority variables may be utilized in a priority 
function. The priority variables may be normalized as is desired. In turn, the priority 

function maps the different combinations of priority variables to a unique priority value. 
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Accordingly, each job that is submitted to the engine 104 is assigned a priority value based 
upon the job's corresponding project, user, and cost in accordance with one embodiment 
of the systems and methods of the invention. 

Once the priority setting portion 300 establishes a priority value of a submitted job, 

5 this priority information is then stored in the memory 340 in any suitable manner. 

Subsequent to the priority value being assigned, the queue placement portion 310 initiates 
operation with respect to that particular job for which the priority value was determined. 
Of course, it should be appreciated, that operations of the priority setting portion 300, the 
queue placement portion 310 and the service portion 320 are continuous in that jobs are 

10 continually being submitted, prioritized, queued and serviced, i.e., performed. 

In accordance with embodiments of the systems and methods of the invention, a 
job is placed in a particular queue based on the job priority value. To explain further, the 
queue placement portion 310 utilizes a hierarchical queue structure that includes both 
queues and queue sets in accordance with one embodiment. As a result, in accordance 

15 with an embodiment of the method and system of the invention, each job may have two 
priority values, i.e., a "queue set priority value" and a "queue priority value." The queue 
set priority value determines which queue set the job is placed into. Further, the queue 
priority value determines which queue, within a particular queue set, the job is placed. 
Further details of both the queue set and queue are described below. 

20 In accordance with further aspects of the invention, other priority values may be 

used which relate to various aspects of a job. For example, a priority value may be 
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provided for "where a job should be" in a particular queue relative to another job in that 
queue. Further, it should be appreciated that one or more types of priority values can be 
assigned to a job. For example, a job may be assigned one or more of a queue set priority 
value, a queue priority value, a relative priority value (within a queue), and other priority 
5 values, for example. 

As described above, the memory 340 includes a queue portion 400. Once a 
priority value or priority values are determined for a particular job, this priority value 
information, as well as the particulars of the job, are stored in the queue portion 400. Fig. 
5 is a block diagram illustrating further aspects of the queue portion 400. 

10 Fig. 5 is a block diagram showing in further detail the queue portion 400 in 

accordance with one embodiment of the method and system of the invention. As shown in 
Fig. 5, the queue portion 400 includes a plurality of queue sets. Specifically, the queue 
portion 400 includes a queue set A 410, a queue set B 420 and a queue set C 430. 

As shown in Fig. 5, the queue set A 410 contains a plurality of jobs 412. In a 

15 similar manner, the queue set B 420 contains a plurality of jobs 422. The queue set C 430 
also contains jobs. In accordance with one embodiment of the systems and methods of the 
invention, each queue set (410, 420, 430) has a priority range associated with that 
particular queue set. The range, as well as the queue set/queue structure, is defined by a 
system administrator, or other suitable person, for example. For example, queue set A 

20 may have a priority range 1-5; queue set B may have a priority range 6-30; and queue set 
C may have a priority range 31-100. Such priority ranges may be utilized when priority 
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values of respective jobs vary from 0 to 100. Accordingly, jobs are inserted into a 
particular queue set (410, 420, 430) based on the priority value of the particular job. Thus, 
if a job has a priority of between 1 and 5, then that particular job will be inserted into 
queue set A 410. Alternatively, if a particular job possesses a priority value of 27, for 

5 example, that particular job will be inserted into queue set B 420. 

In accordance with one embodiment of the systems and methods of the invention, 
all jobs within a particular queue are treated with equal priority. Consequently, a job with 
a priority value 1 receives the same processing priority by the service portion 320 as a job 
with a priority value of 2, 3, 4 or 5. Further, jobs may be inserted into the end of each 

10 queue. This provides for a first in-first out (FIFO) processing of the jobs in a particular 
queue. However, it should be appreciated that all jobs within a particular queue do not 
have to have the same priority. Rather, one or more jobs may have a different priority, as 
is desired. 

In accordance with a further embodiment of the systems and methods of the 
15 invention, multiple queues may be defined within each queue set. For example, this 
arrangement of each queue set may be performed by an administrator or other suitable 
person. When utilizing a queue within a queue set, each job may possess two levels of 
priority values, as is described above. The first priority value is to define the queue set, 
and the second priority value is to determine a particular queue within that queue set. Fig. 
20 6 is a diagram in accordance with a further embodiment of the queue portion 400. 
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As shown in Fig. 6, the queue portion 400 includes queue set 510, queue set 520 
and queue set 530. The queue set 510 includes queue Al 510 and queue A2 516. The 
queue Al 512 contains various jobs 514. Similarly, the queue A2 516 contains jobs 518. 

The queue sets 520 and 530, as shown in Fig. 6, also contain multiple queues as 
5 well as jobs within those queues. Specifically, queue set 520 contains queue Bl 522 and 
queue B2 526. Each of the queue Bl 522 and the queue B2 526 contains jobs. Further, 
the queue set 530 contains queue CI 532 and queue C2 536, each of which contain jobs. 

In accordance with one embodiment of the method and system of the invention, 
jobs may be placed into the various queue sets and queues depending on the priority value 
10 or values of a particular job. Any of a wide variety of priority schemes may be utilized to 
place the jobs in the various queue sets and queues. For example, Table 1 below shows an 
illustrative priority scheme. 



QS Priority Range 


Queue Set 


Queue Priority 
Range 


Queue 


1 - 5 


A 


1-2 


Al 


1 - 5 


A 


3-5 


A2 


6-30 


B 


6-20 


Bl 


6-30 


B 


21-30 


B2 


31-100 


C 


31-60 


CI 


31 - 100 


C 


61 - 100 


C2 



TABLE 1 

15 A job with a queue set priority between 1 and 5 will be assigned to queue set A. 

Further, a queue set (QS) priority range of 6-30 results in the queue placement portion 310 
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placing a job in the queue set B 520. Further, a QS priority range of 31-100 results in the 
queue placement portion 310 placing a job in the queue set C 530. 

Further, Table 1 also shows queue priority ranges, as opposed to queue set priority 
ranges. For example, a queue priority range of 1-2 results in a job being placed in the 
5 queue Al 510. Further, a queue priority range of 6-20 results in a job being placed in the 
queue Bl 522. As shown in Table 1, the queue priority range may vary between 1-100. 

As shown in Table 1, the queue priority range uniquely identifies which queue a 
particular job is placed based on the priority value of that queue. Since the queue priority 
range uniquely determines which queue a job is placed, it should be appreciated that the 
10 queue priority range may be utilized by itself, to not only control which queue, but also 
which queue set. Accordingly, it should be appreciated that a variety of priority schemes, 
both relating to queue set priority values, queue priority values, or both may be utilized to 
place a particular job in a particular queue set and queue. 

As described above with reference to Fig. 5, in accordance with one embodiment 
15 of the invention, jobs placed by the queue placement portion 3 10 into the same queue are 
treated equally. For example, each new job placed within a particular queue is inserted 
into the end of that queue. Consequently, a job with a priority value of 1 receives the 
same processing priority as a job with a priority value of 2. 

It should be appreciated that queue set priority and queue priority may be the same 
20 value or two different values. With reference to Table 1 above, as described, the range 
used to divide jobs into different queues is simply a further refinement of the ranges used 
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due to find queue sets. This may be the case but does not necessarily have to be. That is, 
a second priority value may be used with different range values to place jobs into queues. 
However, a job may preferably be assigned a queue set, in accordance with some 
embodiments of the invention, prior to being inserted into a queue within that queue set. 
Additionally, it is possible to define a configuration with only one queue set and multiple 
queues within that set. 

As described above, priority functions may be used to map various priority 
variables to a priority value. It should be appreciated that when the number of 
combinations of priority variables, such as project, user, and cost, is small, then it is 
relatively simple to explicitly define a mapping table for each combination. However, 
when the number of combinations is large, it becomes more difficult to define the 
mapping explicitly. Rather, it should be appreciated that it may be easier to normalize the 
priority variables into numerical values and define an arithmetic function which, based on 
input of priority variables, will output a priority value. 

In accordance with one embodiment of the systems and methods of the invention, 
priority functions may be defined at the queue structure level. Regardless of whether the 
implementation is in arithmetic calculation, or alternatively, some sort of mapping, the 
definition of the function may be assigned to a queue structure. Priority functions are 
evaluated by the priority setting portion 300 and the resulting value is used to assign the 
job to a queue. It should be appreciated that report cost functions should be defined at the 
same level as priority functions. 
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It should be appreciated that a job may need to be assigned to a queue before all 
the priority variables to the priority functions are known. For example, a job may be 
placed into a queue before the job has been assigned an estimated cost. In this situation, a 
default value may be assigned to the missing priority variable. The missing priority 
5 variable may be updated once the information is known, assuming the job has not already 
been processed. 

Hereinafter, further aspects of the systems and methods of the invention will be 
described with reference to operation of the service portion 320. Specifically, aspects of 
the invention relating to job servicing will be described below. In accordance with one 

10 embodiment of the systems and methods of the invention, the service portion 320, given a 
set of prioritized queues, determines the order in which jobs are dequeued or serviced. 
Various methods may be utilized to service the queued jobs. Specifically, the service 
portion 320 may utilize a first in first out technique, a fixed thread-selfish technique, a 
fixed-thread cooperative technique, a highest priority first technique or alternatively, a 

15 weighted share technique, or any other suitable technique. As described below, the 
various methods are discussed in terms of queues and/or queue sets. 

The service portion 320 may utilize a first in first out technique. Using this 
technique, the service portion 320 dequeues and services jobs in the order in which the 
jobs entered the queue. When this method is used and only one queue exists, jobs are 

20 prioritized based only on their time of submittal. Accordingly, the first in first out 

technique is not effected by how many threads are used for job servicing. In accordance 
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with one embodiment of the systems and methods of the invention, this method is used to 
process jobs, within a queue, regardless of how jobs across queues are serviced. Fig. 7 is a 
diagram illustrating the first in first out technique. As shown in Fig. 7, the queue Al 512 
contains a plurality of jobs 514. As shown in Fig. 7, the first job in, is the first job out, 
5 utilizing the first in first out technique. 

In accordance with a further embodiment of the invention, the service portion 320 
may use a fixed thread-selfish technique. In this technique, each queue is assigned a 
certain number of threads. Those threads are dedicated to that particular queue and cannot 
service jobs outside of that queue. As shown in Fig. 8, queue Al 512 has one dedicated 

10 thread Tl and queue A2 516 has two dedicated threads (T2 and T3). Accordingly, even if 
queue Al 512 is full and queue A2 516 is empty, the threads T2 and T3 will not service 
jobs from queue Al but will wait idle until a job enters queue A2. This technique ensures 
that jobs in each queue are serviced at constant levels and not effected by the activity of 
other queues. However, it should be appreciated that utilizing this technique, threads are 

15 not polled, i.e., utilized, efficiently and may sit idle while other queues are full. 

A third job servicing technique is a fixed thread-cooperative technique. In a fixed 
thread-cooperative technique, each queue set is assigned a certain number of threads. If a 
thread is idle and there are no jobs in need of processing in the queue set, the thread may 
switch to another queue set. As a result, the thread will be on temporary loan, so to say, to 

20 the second queue set and will check for jobs in the primary queue set after servicing each 
job in the secondary set. Fig. 9 is a diagram illustrating the fixed thread-cooperative 
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technique. As shown in Fig. 9, the thread T2 is on loan to the queue Al 512. Since there 
are no pending jobs in the queue A2 516, it should be appreciated that if T2 did not switch 
to queue Al 512, the thread T2 would sit idle. After each job T2 processes in queue Al 
512, the thread T2 first checks to see if new jobs have entered queue A2 516. If so, then 
the thread T2 switches back to its original queue A2 516. 

In configurations with more than two queues, it should be appreciated that threads 
may switch to more than a single queue. For example, threads may move in a serial 
fashion from one queue to the next based on a defined priority for the queues. This 
priority is different than job priority. As shown in Fig. 9, for example, queue Al 512 may 
be the highest priority queue followed by A2 with A3 having the lowest priority. With 
this priority scheme, threads may move from A2 to Al, but not to queue A3. As a result, 
this arrangement allows limited cooperation. If queues are not prioritized, threads from 
empty queues should switch to busy queues using a round robin scheme, for example. 
With further reference to Fig. 9, for example, thread T2 will service a job from queue Al 
512, and then service a job from queue A3 517. However, it should be appreciated that 
threads are not limited to moving in serial fashion. Rather, threads may move in any of a 
number of ways, including in a serial fashion. 

In accordance with a further embodiment of the systems and methods of the 

invention, the service portion 320 may utilize a highest priority first technique to process 

the queued jobs. In the highest priority first technique, the service portion 320 services 

each queue set in serial fashion based on priority. That is, all available threads service 
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jobs in the highest priority queue set first. Accordingly, none of the threads are allocated 
to any particular queue set. One shortcoming of the highest priority first technique is that 
lower levels queues may rarely be serviced. Fig. 10 shows aspects relating to the highest 
priority first technique. As shown in Fig. 10, the queue Al 512 may be defined as having 

5 a higher priority than the queue A2 516. Further, threads Tl, T2 and T3 are not assigned 
to either queue (512, 516) but will always attempt to service jobs in queue Al 512 prior to 
servicing jobs in queue A2 516 utilizing the highest priority first technique. 

In accordance with a further embodiment of the systems and methods of the 
invention, the service portion 320 may utilize a weighted share technique. In using the 

10 weighted share technique, each queue has a weighting factor. Threads are not assigned to 
any one queue but are shared among all queues. The weighting factor allows a queue to 
receive higher service levels relative to other queues. To explain with reference to Fig. 11, 
for example, queue Al 512, queue A2 516, and queue A3 517, have weights of 1, 3 and 1, 
respectively. Further, there are four threads allocated to service all of the queues. Using 

15 the weighted share technique, thread Tl will service one job in queue Al. Threads T2, 
T3, and T4 will service a total of three jobs in queue A2 516. Thereafter, the first thread 
to finish processing will service one job in queue A3 517. The next thread to finish 
processing will service one job in queue Al 512. Thereafter, three jobs from queue 
A2516 are processed all by one job from queue A3 517. This cycle continues, always 

20 processing jobs in a cyclical manner and with respect to the relative weighting factors. 
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Further, this method ensures that all threads are always busy as long as pending jobs exist. 
As shown in Fig. 1 1, the threads Tl, T2, T3 and T4 may be pulled from a thread pool 560. 

Hereinafter, further aspects of servicing of queue sets and queues will be described 
in accordance with embodiments of the systems and methods of the invention. 
Specifically, it should be appreciated that various "governors" may be utilized by the 
service portion 320 in processing of jobs. In accordance with one embodiment, the service 
portion 320 honors all governors, which are in place. For example, one governor may 
limit the number of jobs any one user may have concurrently executing. This governor, in 
accordance with one embodiment, holds true whether the jobs exist within one queue, 
multiple queues, or across queue sets. Accordingly, when this limit is reached, the service 
portion 320 attempts to process the next job in the current queue instead of treating the job 
as processed and skipping to the next queue based on the servicing method. 

It should be appreciated that when using queue sets, a designer has the ability to 
utilize servicing methods in combination. That is, one service method may be used at the 
queue set level and another at the queue level. The following chart lists possible 
combinations of methods. It should be noted that first in first out is only used within a 
queue and would not be defined as a method across queues or queue sets, in accordance 
with one embodiment of the method and system of the invention. 
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Queue Set Method 


Queue Method 


Description 


Fivpd Thread f<\p1fict^ 


rixeu i nreaa ^oenisn ) 


Threads are dedicated to only specific, 
multi level priority groups. 


Fixed Thread (Selfish) 


Fixed Thread (Cooperative) 


Threads are dedicated to queue sets and 
cannot service other queue sets. Within 
each queue set, threads are divided among 
various queues and can be loaned to other 
queues. 


Fixed Thread (Selfish) 


Highest Level First 


Threads are dedicated to queue sets and 
cannot service other queue sets. Within 
each queue set, threads will process jobs 
from the highest priority queue first. 


Fixed Thread (Selfish) 


Weighted Share 


Threads are dedicated to queue sets and 
cannot service other queue sets. Within 
each queue set, threads are pooled and 
process jobs based on the defined queue 
weights. 


Fixed Thread (Cooperative) 


Fixed Thread (Cooperative) 


Threads are dedicated to queue sets but 
may be loaned to other queue sets during 
idle times. Within each queue set, threads 
are dedicated to queues but may be loaned 
to other queues during idle times. 


Fixed Thread (Cooperative) 


Highest Level First 


Threads are dedicated to queue sets but 
may be loaned to other queue sets during 
idle times. Within each queue set, threads 
will process jobs from the highest priority 
queue first. 


Fixed Thread (Cooperative) 


Weighted Share 


Threads are dedicated to queue sets but 
may be loaned to other queue sets during 
idle times. Within each queue set, threads 
are pooled and process jobs based on the 

UC-1JU1CU. L]UCUC WClgIlLi>. 


Weighted Share 


Highest Level First 


Threads are pooled across all queue sets 
and process jobs based on the defined 
queue set weights. Within each queue set 
threads will process jobs from the highest 
priority queue first. 


Weighted Share 


Weighted Share 


Threads are pooled across all queue sets 
and process jobs based on the defined 
queue set weights. Within each queue set, 
threads are pooled and process jobs based 
on the defined queue weights. 



TABLE 2 
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It should be appreciated that the system 100 in accordance with the systems and 
methods of the invention, provides a great deal of flexibility in defining queue structures, 
priority schemes, and job servicing schemes. Beneficially, this flexibility is presented to a 
system administrator, for example, in as simple a manner as possible. To provide this 

5 flexibility, the system administrator configuring priority and servicing schemes within the 
system 100 should be able to make a series of assumptions. Of course, the set up of the 
priority schemes, for example, will allow such assumptions to be made. 

For example, a first assumption might be that prioritization and servicing applies 
in the same manner to all processing units. That is, although the system 100 may support 

10 schemes that vary across processing units, a system administrator should only be 

concerned with one prioritization and servicing scheme. Further, it should be appreciated 
that the prioritization and servicing scheme may be fixed for certain jobs. For example, 
the prioritization and servicing scheme may be fixed for both metadata browsing and for 
element browsing. As should be appreciated, metadata browsing is a type of request 

15 where the end user is looking through the set of OLAP questions (e.g. reports) that have 
been defined in the system. Element browsing is a type of request where the end user is 
looking through the set of data elements available in the database when asking a question. 
For example, if a user wants to request a report to show sales for a store during Q4 2000, 
and the system prompts the user by saying "which store" and shows the user a list of 

20 stores, the request to generate that list of stores from the database is an element browse. 
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To explain further, although priority schemes are available to all processing units, 
ease of use by end users may be helped by characterizing priority schemes in terms of a 
processing unit that executes queries. To the end user, configuring the priority and 
servicing scheme may be equivalent to configuring the priority and servicing scheme for 

5 executing jobs against a warehouse, for example. 

In accordance with one embodiment of the systems and methods of the invention, a 
scheme, as described above, may be configured utilizing a two step process. First, the end 
user may identify a set of priority queues and the rules for assigning jobs to those queues. 
Secondly, the end user selects a servicing scheme to select jobs from the queues for 

10 execution. 

A system designer, for example, may identify priority queues, i.e., or in other 
words define "priority", utilizing various approaches. In accordance with one embodiment 
of the systems and methods of the invention, a system designer defines a desired priority 
scheme using a list of available projects and a list of available user groups. Then, the 

15 system designer picks a particular project from the list of projects and a particular user 
group from the list of user groups. This combination of chosen items, from lists may be 
used to create a new "bucket", i.e., a new queue. Accordingly, a particular combination 
chosen by the system designer is assigned to the bucket or queue. Similarly, the system 
designer may assign any of a plurality of combinations to form additional queues as is 

20 desired. 
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It should be appreciated that it may be desirable to limit the number of 
combinations that are possible. For example, the system designer may limit himself or 
herself to three priority groups and three cost ranges, for example. 

A system designer also selects a job servicing scheme. When selecting a job 
5 servicing scheme, a system designer selects from among the various job servicing schemes 
described above. Based on the list of queues defined, a system designer can sort the 
various defined queues into queue sets and specify job servicing algorithms or other 
processes at the queue set level as well as at the queue level. 

In accordance with one embodiment of the systems and methods of the invention, a 
10 system administrator, for example, may utilize a series of steps to define a prioritization 
and servicing scheme. Fig. 12 is a flow chart showing these steps to define a prioritization 
and servicing scheme. As shown in Fig. 12, the process starts in step 700. Then, the 
process passes to step 710 in which the number of queues is set. Then in step 720, the 
process selects the priority variables. Then, in step 730, the cost function is defined. After 
15 step 730, the process passes to step 740. 

In step 740, the cost groupings are defined. In step 745, the relevant user groups 
are selected. Then, in step 750, the combinations to the queues are mapped. Then, in step 
760, the queues are grouped into queue sets. Then, the process passes to step 770. In step 
770, the servicing schemes are defined. Then, the process passes to step 780. In step 780, 
20 the process ends. Hereinafter, further aspects of the process of defining a prioritization 
and servicing scheme will be described with further reference to Fig. 12. 
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In accordance with embodiments of the systems and methods of the invention, 
each step is described in detail below. However, it should be appreciated that the 
invention is not limited to the process of Fig. 12 as described above. Further, such steps 
may be varied or altered as is desired. 
5 The system administrator may first select the number of queues to be used in step 

710. For example, the number of queues used may be limited to 5 queues. 

The system administrator may then select the variables that may be considered in 
the priority function in step 720. Illustratively, the options may be project, user, and cost. 
It should be appreciated, only the variables selected will be utilized to factor into the 
10 function. Any of a variety of variables may be used as is desired. 

If cost were selected as one of the relevant priority variables, the system 
administrator may define a cost function to map combinations of priority, type, historical 
cost and estimated cost, as described above, to unique values, for example. 

Further, the system administrator may be able to define a linear combination of 
15 characteristics. For example, the system administrator may assign coefficients to each 
characteristic to determine the cost function. For example, the cost function may be 
defined as: 
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C = (0.5) * report jpriority + (0) * reportjype + (0.25) * historical_cost + 
(0.25) * estimated_cost 

As described above, the report cost function may be defined in such a way that the 
possible values are normalized to a range of 0 to 100, in accordance with one embodiment 
of the systems and methods of the invention. 

Further, it should be appreciated that once a cost function has been defined, the 
system administrator defines a set of priority groups based on report cost. For example, 
the user may decide to establish three groups: 

1. Group A: Report cost between 0 and 40; 

2. Group B: Report cost between 41 and 80; and 

3. Group C: Report cost between 81 and 100. 

As a result, it should be appreciated that the set of cost groupings cover each 
possible cost value from 0 to 100, for example. 

As shown above in Fig. 12, the relevant user groups are selected in step 745. That 

is, if user was selected as one of the relevant priority variables, the system administrator, 

or other appropriate person, selects the defined user groups that will be relevant for 

establishing priority. It should be noted that all user groups defined on the system may not 

be appropriate for defining priority. That is, the system administrator will select only 

those groups that need to be considered for establishing priority. Further in accordance 

with one embodiment, the interface might also force the user to include an "all other" user 

group. This catch all will ensure that any user who submits a job will belong to at least 

one group that is used in determining priority. 
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Further, it is also possible for a job to be submitted by a user who belongs to more 
than one group. In this situation, there could be a conflict in the priority assigned to a job. 
Accordingly, the priority function should assign the highest possible priority to a job if the 
associated user could be considered a member of more than one user group. 

As shown in step 750 of Fig. 12, the combinations are mapped into queues. That 
is, once priority variables have been selected, the system administrator maps all possible 
priority combinations to the available queues. Depending on the chosen priority variables, 
the user should see a list of projects, a list of user groups, and a list of cost groups. The 
user should, in accordance with embodiments of the methods and systems of the 
invention, be able to select combinations of these variables and associate them with the 
available queues. Further, each combination is assigned a queue. 

In step 760 of Fig. 12, each queue is grouped into queue sets. At this point, the 
prioritization scheme is defined and the system administrator, or other appropriate person, 
is ready to define the servicing scheme for the available queues. The system administrator 
may choose to group queues into queue sets in order to apply a different servicing policy 
at the queue set level than at the queue level. The user may group the available queues 
into any number of queue sets, but queue sets may not be further grouped together. 

In step 770, as shown in Fig. 12, the servicing schemes are defined. It should be 
noted that regardless of whether the system administrator has one or two levels in the 
queue structure, she may now define the thread service policy for each queue set. The user 

should see the available queues and the available processing threads, i.e., the database 
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connections, that will serve those queues. All database connections may be associated to 
one of the available queue sets in accordance with embodiments of the methods and 
systems of the invention. 

Accordingly, the system administrator defines the servicing policy within each 

5 queue set. For each queue set, the system administrator should select one of these 
servicing schemes defined above including fixed thread - selfish, fixed thread - 
cooperative, highest priority first, or waited share, for example, or another desired 
servicing scheme. Depending on the selection, the user also specifies relevant parameters 
to define the servicing scheme. 

10 For example, in the fixed thread - selfish scheme, the user specifies the number of 

threads dedicated to each queue. For the fixed thread - cooperative scheme, the user 
specifies the number of threads dedicated to each queue. For the highest priority first 
scheme, no additional parameters are required. Lastly, for the waited share scheme, the 
user defines a weighting factor for each queue. Illustratively, the weighting factors should 

15 be specified as integers between 0 and 255. 

As described above, each of the incoming jobs may be serviced based on a 
servicing scheme. It should further be appreciated that servicing each of the incoming 
jobs based on the servicing scheme may include scheduling a job for servicing at a later 
time, in some manner, as is desired. Such a scheduled job might then take priority over 

20 future processing of jobs, for example. 
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In accordance with one embodiment, the system administrator may be able to 
manually change the priority of a particular job. That is, while a job is still in a query 
execution queue, the system administrator should have the ability to change its priority. 
Further, additional variations may be utilized further to the systems and methods described 
above. For example, the system 100 may provide the ability to configure different 
prioritization and servicing schemes for different pools of database connections. Further, 
the system 100 might provide that the prioritization functions change via a schedule, for 
example, change between working hours and off- working hours. Further, the service 
policies might change via a schedule. 

It should be appreciated that a queue or a queue set need not be defined based on 
priority assigned to a job. Rather, queue sets could be defined based on other 
characteristics. For example, one or more queue sets may be created, wherein each queue 
set may be defined based on one or more queue set factors. The queue set factors may 
include one or more of a range of priority values, or any of a variety of other queue set 
factors, as may be desired. 

It should be appreciated that the systems and methods of the invention are 

described above using the arrangement of a queue set, which contains multiple queues. 

However, the various features and concepts, i.e., the various priority and servicing 

schemes, described above dealing with the processing and manipulation of queue sets may 

also be applied to queues, whether such queues are in a queue set, or alternatively, not in a 

queue set. Further, the various features and concepts described above dealing with the 
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processing and manipulation of queues, which are in a queue set, may also be applied to 
queues which are not disposed in a queue set. 

In other words, the teachings above dealing with a queue set may be applied to 
queue. Further, as used herein, a "queue set" maybe thought of and characterized as a 
5 queue. In a similar manner, what is described above as a "queue' 1 might be thought of and 
characterized as a "sub-queue." Thus, a plurality of sub-queues may be disposed in a 
queue in the same manner as a plurality of queues are disposed in a queue set above, and 
further, such a queue/sub-queue arrangement may utilize the features and concepts 
described above, i.e., that were described for a queue set/queue arrangement. Further, it 

10 should be appreciated that the systems and methods of the invention may also be extended 
to further sub-sets of queues, i.e., a queue that contains a sub-queue, which in turn 
contains a sub-sub-queue. Accordingly, the systems and methods of the invention provide 
a wide variety of techniques to prioritize jobs, whether those jobs are disposed in a queue 
set, a queue, a sub-queue, or a sub-sub-queue. 

15 While the foregoing description includes many details and specifications, it is to be 

understood that these have been included for purposes of explanation only, and are not to 
be interpreted as limitations of the present invention. Many modifications to the 
embodiments described above can be made without departing from the spirit and scope of 
the invention, as is intended to be encompassed by the claims and their legal equivalents. 
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